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^^0 ' Statistical mechanics is generalized on the basis of an information theory for inexact or incomplete 

^ , probability distribution. A parameterized normalization is proposed and leads to a nonextensive 

t^ ■ entropy. The resulting incomplete statistical mechanics is proved to have the same theoretical 

characteristics as Tsallis one which is based on the conventional normalization. 
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We need a generalized statistical mechanics to replace Boltzmann-Gibbs-Shannon (BGS) one because BGS theory 
is not capable of interpreting some observed results of physical systems with complicated strong interaction, long 
range correlation, longtime memory or with noneuclidean and nonsmooth space-time structure such as in the theory 

c/3 , of fractal space-time and Cantorian E°° |l|-^. Examples of such systems exist everywhere, from cosmic systems, 
ordinary optical, magnetic or electronic materials around us, fractal and chaotic systems, till microscopic systems 
such as nuclei. For detailed comments on the breakdowns of BGS theory and on the possible solutions, the reader 
is advised to read references [^|6| and the references there-in. Complicated physical systems are often nonextensive. 
For this kind of systems, we already have TsaUis nonextensive statistical mechanics [0g] which has been successfully 

fH , used to interpret some peculiar physical phenomena and fractal structures. Tsallis entropy is given as follows : 
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^- S, = -k i^i^,(gei?) (1) 

►^ ' where pi is the probability of the state i among v possible ones 
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r-^ ■ The independence of two probability distributions [pi{A)...pi{A)...py{Ay\ et [pi{B)...pj{B)...pu{B)\ is defined as usual 
O: byQ 

t^: p^{A)pj{B) = p,,{AiJ B) (3) 

where pij {A U B) is the probability for the state i and j to be occupied at the same time. We obviously have 
'^ I Sr=i Si'=iPy(^ US) — 1). We see that Tsallis statistics, as BGS one, is constructed within Kolmogorov algebra 
b^ ■ of complete probability distribution pfl. On the other hand, the expectation value < O > of an observable O is 
fj \ supposed to be calculated in the following way. 



X 



Y.P^ = 1- (2) 



<0>^2pi^. (4) 

where Oi is the value of O at the state i. 

I want to emphasize here that, as mentioned above, up to now, all statistical theories (BGS, Tsallis, etc) are based 
on the information theory for complete probability distribution according to 'complete random variables' {CRV) 



^This kind of "independence" for correlated subsystems can be interpreted by the existence of thermodynamic equilibrium in 
the composite system H 



| [10| . A CRV, ^, takes distinct values X = {xi,X2, ---jXy} (also referred to as v events or states) with probabilities 
P = {PiiP2, ---jPv} and X constitutes a complete ensemble ilx defined by all possible values of ^. A simple example of 
CRV is the position of a particle in a closed box. All the possible values of the position constitute a complete ensemble 
of positions defined in the box. We call i^ an independent CRV if all its values are independent and incompatible 
(exclusive). In this case, P is called a complete distribution and satisfies the requirement of Eq. (S). 

We can say that all statistical theories constructed within Kolmogorov algebra of complete probability distribution 
should be logically applied to physical systems of which all the possible physical states are well-known and for which 
we can in practice count all of the states to carry out the calculation of probability or of whatever physical quantities. 
This often requires that we can find the exact hamiltonian and also the exact solutions of the equation of motion of 
the systems to know all possible states and to obtain the exact values of physical quantities. 

The generalization of BGS theory in the present paper is based on the information theory for incomplete probability 
distribution with incomplete random variables (IRV), that is the number w of the possible values {a;i,a;2, ...,x^} of 
IRV is greater or smaller than v. Another case where the present generalization can be applied is that, though w — v, 
one can not calculate the exact probability distribution P = {pi,p2, ■■■,Pv}- 

In physics, the above two cases are possible if we do not know or can not write analytically all the interactions in 
a system. In these cases, the solution of the equation of motion is no longer exact, and we can no more in practice 
count all the possible states and calculate in a precise way any physical quantity of the system even for the countable 
(well-known) states. So the calculation of the probability pi is not exact either. Within this hypothesis, Eq. (|l|) 
should be written as |10| 

w 

Y,P^=Q^^- (5) 

4=1 

where w is only the number of the countable states given by the solution of the equation of motion and can be greater 
or smaller than u, the real number of states of the physical system under consideration. Q should depend on the way 
to find the countable states and probabilities, or in other words, on the neglected interactions. 

The idea of the present generalization of BGS statistics is that we recognize the inadequacy of our knowledge 
of physical systems, i.e. Eq.(|g), and try to tackle the problems in a approximate way allowing us to work within 
Kolmogorov algebra of probability as BGS statistical mechanics does. We also require that the BGS statistics be a 
special case of the generalized formalisms. As mentioned above, the present nonextensive generalization is carried 
out with the hypothesis of an incomplete ensemble of states and of an inexact probability distribution. The reader will 
find that this incomplete statistics has the same theoretical features as Tsallis one for complete ensemble of states. 

II. INCOMPLETE NORMALIZATION 

Now let us postulate 

w w 

4=1 ^ 1=1 

SO that 

w 

Y,pl^i,{qe[o,^]) (7) 

i=l 

since pi < 1, we have to set q e [0, oo]. Eq. (^ now becomes : 

w 

<o>= J2pIo,. (8) 

1=1 

Don't forget that the w states are only the well-known (countable) ones and therefore do not constitute a complete 
ensemble of states of the system under consideration, w can be greater or smaller than the real number of all the 
possible states, depending on the approximations we use to find the analytic expression of hamiltonian and the solution 
of the equation of motion of the system. 

Eq. (ph is a kind of redistribution of the effect of neglected interactions (or of the unknown events) on the known 
events. This is quite normal because the known events and their probability distribution are closely related to the 



neglected interactions. This q-deformation of probability p'^ is not a new invention. It was the choice of almost all the 
authors who intended to generalize Shannon information theory ||5|,|l0|]. It is used by Renyi to calculate the q-order 
measure of information and related to an average gain of lost information due to the incomplete distribution, pf is 
also used in the fractal theory to favor contributions from events with relatively high values (when q > 1) or low values 
(when q < 1) in the calculation of multifractal measure [O. In any case, Eq. (M) is a (reasonable) simplification of 
Eq.(^ which allows, we will find later in this paper, to work within the mathematical framework of BGS statistical 
mechanics. 

In the simplified incomplete normalization Eq. (|j), p^ can be called the effective probability of the event i and pi the 
real probability which is physically useful only when g = 1 for the cases where no interaction is neglected and w is the 
total number of events in a complete ensemble. When q is different from unity, the difference {q — 1) is related to the 
neglected interactions. We can see later in this paper that q is related to the extra information (entropy) compared 
to that we obtain in BGS framework, q can also be related in explicit ways to other basic quantities such as internal 
energy or free energy of the system. 

III. INCOMPLETE INFORMATION THEORY 

It is well known that the conventional (extensive) information theory is based on the following postulates concerning 
the missing information I{N) to determine the state of a system il of N elements ]1^ : 

n°l) /(I) — (no missing information if there is only one event) 

n°2) /(e) = 1 (information unity) 

n°3) /(-/V) < /(TV + 1) (more information with more elements) 

^°4) liUti Nr) - ELi HN^) (additivity) 

n°5) I{N) = ly + X^iLi Pi^i-^^) (additivity of information measure in two steps) 

where v is the number of all the subsystems fii with Ni elements and pi = ^ \s the probability to find an element 
in Oj (equiprobability) . /„ is the missing information to determine in what subsystem an element will be found. The 
postulates n°l to n°4 lead to Hartley formula of information measure [Q : 

I{N) = InN. (9) 

Then the postulate n°5 can yield Shannon formula for /„ and entropy. 

For nonextensive systems, the additivity postulate n°A should become, for two systems with A^i and N2 elements, 
respectively : 

I{Ni X N2) = I{Ni) + /(iVs) + f{I{Ni),I{N2)) (10) 

where the form of the function f{I{Ni),I{N2)) is of central importance for all the rest of this nonextensive information 
theory. Considering the necessity to come back to Hartley formula in a special case and in order to find the easiest 
way out, we naturally think of the q-deformed logarithmic function ._ ~^ which — > InN when q ^ 1. So I postulate 

N'^-1 - 1 

I{N) = — . (11) 

1-9 

This generalized Hartley formula corresponds to the following postulates: 

n°l„ex) /(I) = 

n°2„ex)/{[l + (l-9)]T^}-l 
n°3„ex)/(iV)</(iV+l) 

n°Anex) I(Ni X N2) = I{Ni) + /(iVs) + (1 - q)I{Ni) x /(7V2) (non-additivity or nonextensivityQ) . 
As for postulate n°5, I put 

Notice that, pi in the postulate n°5 is replaced in the postulate n°5nex by pf due to the incomplete normalization. 



^This product form of the nonextensive term is also a consequence of the existence of thermodynamic equilibrium in the 



composite system |9[ 



From Eq. (|11|) and the postulate n°5nex, we straightforwardly obtain /^, the information measure given by an 
incomplete probability distribution {pi,p2, ...,pw} defined hy pi = Ni/N : 



iVi-9 - 1 
1-9 
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i^ + EpV-^, 
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which yields 



1.^-T.pf-T^ 



(12) 



(13) 



IV. NONEXTENSIVE GENERALIZATION OF BGS STATISTICS 



Now we postulate for the nonextensive entropy : 



.1-9 



(14) 



or 



w q 



bq — k 



i=iPi-2Zi=iP' 
1-9 



or even more simply 



Of, — k. 



1-9 



(15) 



(16) 



where g > is required by the incomplete normalization Eq. (0). It can be easily verified that all the properties of 
Tsallis entropy (nonnegativity, concavity, pseudo-additivity, etc) H are preserved by this entropy [Eq. (nj) to (|lF 
because it is nothing but the Tsallis one with a new normalization condition. 



For microcanonical ensemble, we extremize 5*^ with the condition in equation (M) and obtain p' = 1/w and 



Do — k- 



w 1 — 1 
9-1 



(17) 



which tends to 5*1 = klnw in the 9^1 limit. 

For canonical ensemble, maximum entropy Eq.(|l6|) with Eqs. ([7|) and (|^) (for energy) as constraints, i.e. 



yields 



^ w w 



[I ~ (l - q)PiE,)] — 



= 



(18) 



(19) 



with 



z,= 



J2[^ - (1 - q)f3E.,]- 



(20) 



To obtain Legendre transformations, we take Eq. (|l4| ) and replace Pj "^ by equation (|l9f), remembering equation 
(^ and (^), we obtain 



J„ 



Z«"i - 1 

k=^ — - 

g-1 



k(3Zf'U, 



which, with the help of the thermodynamic relation ^ 



dS„ 



kT 



leads to 



and 



F„ 



Uq - TSq 



-kT- " 



g-1 



The Uq — Zq relation is a little complicated. From equation (g) and (jij), it can be recast as follows 

1 d 



Ua 



Z'qdl3 



:Z' 



where Z' is given by 



Z'q=J2i^-{l-q)PE,]T^. 



(21) 



(22) 



(23) 



(24) 



(25) 



As in Tsallis' case, it is straightforward to verify that all above relations reduce to those of BGS case in the q ^ I 
limit. 

Now we will discuss some points concerning the nonextensivity of the system. The generalized Hartley formula Eq. 
(O) or the nonadditivity postulate n°4:nex suggests that, for two subsystems A and B of a system C = A + B : 



N,,{C)=N,iA) xN,{B). 
and N{C) = N{A) x N{B). These relations assume the factorization of the joint probability p^j or pf 

P%{C)=p'i{A)p]{B) 
which in turn leads to the nonextensivity of entropy. 



Sq(A + B)=Sq{A)+Sq{B) 



k 



Sq{A)Sq{B). 



(26) 



(27) 



(28) 



Eq. ( p7| ) is in fact the definition of the independence of the effective probability pl{A) or pl{B). Considering the 
distribution Eq. (p^), we easily get 



and 



E,,{A + B)= E,{A) + E,{B) + {g - l)(3E,{A)Ej{B) 



Uq{A + B)^ Uq{A) + Uq{B) + {q - I) (3U q{A)U q{B) . 



(29) 



(30) 



Eqs. (27), (29) and ( |30| ) tell us that ii vAA) and pj (B) are independent, the two systems A and B are dependent 
on each other and correlated by Eqs. (P9| ) or (|30|). But for two independent systems A and B with Eij{C) = 
Ei{A) + Ej{B), we loss Eq. (27) and, strictly speaking, can no more find the relation between Uq(C), Uq{A) and 
Uq{B), unless we put q — 1 and come back to BGS case. As for this problem of correlation, Abe (l2| has studied 
N-body problem with ideal gas model. He concluded that, in thermodynamic limits or in the limit of big N (particle 
number), the correlation term in Eq. (E9h and (pfl) would vanish. The suppression of the correlation, in addition, 
allows to establish the zeroth law of thermodynamics within the framework of nonextensive statistical mechanics with 
escort probability [Q . We mention here that the reader can find an exact establishment of the zeroth law based on 
Eq. (Pq ) and (30) without neglecting the energy correlation |1^ ]. 



V. CONCLUSION 

In conclusion, the conventional BGS statistical mechanics is generalized on the basis of the idea that we sometimes 
can not know all the possible physical states or the exact probability distribution of a complicated physical system and 
so that we have to use the suitable information theory for incomplete probability distribution. The most important step 
of this generalization is the incomplete normalization X^jP? — 1 with a free parameter q (positive) which is dependent 
on the neglected interactions. We have seen that, apart from some minor differences, the present incomplete scenario 
of nonextensive statistics has the same characteristics as Tsallis scenario for complete probability distribution. On 
the other hand, we would like to indicate here that, with the hypothesis of incomplete distribution, the parameter q 
is logically related to the quantity Q in Eq. (ph and so to the interactions neglected in the hamiltonian of the system. 

For example, for a microcanonical ensemble, we can write : g = 1 — -^ or Q = w~5~. In addition, q can be 
related to internal energy or to other basic quantities of physical systems Q . So the understanding of nonextensive 
thermostatistics under the angle of incomplete information may be of interest for interpreting particular values of q 
for different complicated physical systems ||l|-H|. 
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Figure captions : 

Figure 1) Variation of nonextensive microcanonical entropy Sq with countable state number w for different q value. 
We see that Sq increases with increasing q. 



